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SYSTEM FOR SUPPORTING A MULTIPLICITY OF COPY FEATURES 
Background of the Invention 

The present invention relates to processing of a sensed image for an output 

device. 

Existing duplicating devices, such as for example a copy machine, a 
facsimile, and a scanner, include an imaging device for sensing image information (e.g., 
scanning or imaging) from an original document. The output of the duplicating device is 
stored in a file, transmitted across a network, or otherwise provided to an output device, such 
as a printer. Some duplicating devices include sufficient memory to store the sensed image 
in a compressed form or an uncompressed form. After storing the sensed image in the 
memory the duplicating device may provide the stored image to the output device (e.g., file, 
network, or printer) multiple times without having to re-sense the image. Depending upon 
the configuration, the system may permit simultaneous outputting (e.g., file, network, or 
printer) of the image and storing of the sensed image into memory. Unfortunately these 
systems, generally referred to as scan-once-print-many (SOPM), require significant amounts 
of memory to ensure that the entire image will fit within the memory. However, a sufficient 
amount of memory to store an entire image may be prohibitively expensive for consumer 
devices. 

Existing duplicating devices may also include horizontal and vertical cloning 
capabilities, such as those disclosed in Tsuboi et al, U.S. Patent No. 5,124,799. Likewise 



existing duplicating device may include mirror capabilities, such as those disclosed in Arai 
et al., U.S. Patent No. 5,768,484. The image processing pipeline of the duplicating device 
incorporates the horizontal and vertical cloning, or the mirror process, and thereafter a print 
ready data stream is provided to the output device. Unfortunately, this technique requires 
substantial memory and computational requirements which may be cost prohibitive for 
consumer products. 

What is desired, therefore, is a system that provides SOPM, horizontal 
cloning, vertical cloning, and/or mirror functionality in a cost effective manner. 

Brief Description of the Drawings 

FIG. 1 is a block diagram of a typical copy machine image process flow. 

FIG. 2 is an exemplary block diagram of a modified copy machine image 
process flow in accordance with the present invention. 

FIG. 3 is an exemplary block diagram of an implementation of the modified 
copy machine process flow of FIG. 2. 

FIG. 4 is an illustration of nested loops. 

FIG. 5 is an exemplary pseudo code of a copy finishing scenario without a 
significant memory buffer. 

FIG. 6 is an exemplary pseudo code of a copy finishing scenario with a 
significant memory buffer. 

FIGS. 7A-7H is another pseudo code of a copy finishing scenario. 

Detailed Description of the Preferred Embodiment 



It is highly desirable to support a number of copy features, such as mirroring, 
horizontal cloning, vertical cloning, scan-once-print-many, and combinations thereof. 
Existing devices, such as a copy machine, scanner, computer, etc. implement each of these 
features in some manner, however, an efficient implementation is still desirable that reduces 
the necessary computational resources. 

Referring to FIG. 1, a typical copy machine image process flow includes a 
scanner 10 which senses an image. After sensing an image 10 a scanner pre-processing 
(SPP) process 12 typically comprises functions such as compensation for non-uniform 
illumination, compensation for pixel-to-pixel sensitivity variations in the image sensor 
arrays, and spatial alignment of signals obtained from image sensor arrays (such as red, 
green, and blue linear CCD arrays) that are physically non-coincident. In general the SPP 
process 12 compensates for non-uniformities of sensing the image. Other pre-processing 
functions may likewise be performed, as desired. The output of the SPP process 12 is 
provided to an image processing pipeline (IPP) process 14 which performs image processing 
functions, such as color conversions, image analysis to identify areas of text, spatial filtering 
(sharpening of text, smoothing of screened areas), image scaling, and halftoning. In general 
the IPP process 14 modifies the image based upon the image itself. After processing the 
image by the IPP process 14, a data stream representative of an image, such as a bitonal 
image map for inkjet printers, is provided to a printing device 16 potentially through a 
printer driver. In other words, the data stream is ready for printing without further image 
processing. The print ready data stream may need additional "wrapping" of header and 
address information, as necessary. It is to be understood that the duplicating device may be 
any type of sensing device, such as for example, a copy machine, a facsimile, and a scanner. 



The output of the duplicating device may be in any format, such as for example, stored in a 
file, transmitted across a network, a printer, or otherwise provided to an output device. 
Depending upon the configuration, the system may permit simultaneous outputting (e.g., 
file, network, or printer) of the image and storing of the sensed image into memory. 

The typical approach to performing mirroring, horizontal cloning, vertical 
cloning, and scan-once-print many (SOPM) is to include such functionality in the IPP 
process 14. However, performing such functionality within the IPP process 14 requires 
additional memory to create the modified image which may include duplicated portions of 
the original image, as necessary, that is thereafter provided to the printer as a data stream 
including the complete image. 

Referring to FIG. 2 in contrast to the traditional approach of performing the 
functionality of mirroring, horizontal cloning, vertical cloning, and SOPM, within the IPP 
process 14, the present inventors determined that the additional functionality should be 
provided as an output post-processing (OPP) process 18. The OPP process 18 is an efficient 
technique because the image processing for these particular processes is suitable for line-by- 
line processing on a "print ready" data stream. In contrast to the memory and computational 
capabilities for total image processing, line-by-line processing only requires limited memory 
and computational capabilities. By organization of the processes in this manner, the IPP 
process, which requires computational resources and time, need only be run once on each 
image even when providing multiple output images. The OPP process, or portions thereof, 
may be run multiple times on the same image data provided from the IPP process. In 
addition, the OPP process 18 may be retrofitted with an existing IPP process 14. 



One implementation of the present invention may be in form of a multi- 
function machine, such a combination scanner, copier, facsimile, and/or printer. Referring 
to FIG. 3, a multifunction machine may include a copier control processor (CPU) 20, a 
digital signal processor (DSP) 22. The DSP 22 performs the SPP, IPP, and OPP image 
computations, as necessary. The CPU 20 provides commands to the scanner 24 and hence 
initiates the scanning functions of the scanner 24. The CPU 20 also controls (1) the data 
path control 26 from the scanner 24 to the DSP engine 22 and (2) the data path control 28 
from the DSP engine 22 to the printer 16. In addition, the CPU 20 may "wrap" the image 
data from the DSP engine 22 with header and trailer data as required by the printer 16. Also, 
the CPU 22 may supervise the DSP engine's 22 execution of image processing. In order to 
achieve these results preferably the CPU 20 and the DSP engine 22 perform coordinated 
actions to achieve each specific function. The coordinative communication between the 
CPU 20 and the DSP engine 22 is depicted as a bi-directional arrow connecting the CPU 20 
and the DSP engine 22. Other communications may be bi-directional, as desired. It is to be 
understood that any architecture may be used to achieve the desired functionality. 

In many cases the output is provided to a raster scan line device, such as a 
laser or inkjet printer, where the pixels are ordered from left-to-right and top-to-bottom. As 
such, regardless of the particular finishing features selected, the output data (typically in the 
form of binary CMYK separation images) are transmitted to the printer in this raster-scan 
order. In this context, the set of finishing features may be defined as follows. Note that for 
this exemplary definition the "input" and the "output" are defined with respect to the data of 
the OPP process. 
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Mirror: This function reverses the order of the image in each output scan line. 

In other words, the data is provided to the printer for printing the 
image in a right-to-left fashion (where data is normally provided in a 
left-to-right fashion). This results in the image being mirrored along a 
vertical axis, such as for example, the central vertical axis of the 
image. It is to be understood that a portion of the image may be 
mirrored, if desired. The remainder of the image may be omitted or 
otherwise printed in a non-mirrored fashion. 

Horizontal This function replicates each input scan line N times left-to-right 
across 

Clone the output scan line (or right-to-left across the output scan line). A 

portion of each horizontal scan line may be duplicated, if desired. 
The system may ensure that the width of the output scan line is at 
least N times as wide as the input scan line, or otherwise sufficiently 
wide to print the original image and the replicated portions thereof. 

Vertical This function replicates each input image M times down the output 
page. 

Clone In other words, the system plays out the set of the input image scan 

lines multiple times in succession. Fewer than all of the scan lines 
may be duplicated, if desired. The system may ensure that the output 
page contains at least M times the number of lines as the input image, 
or otherwise a sufficient number of lines to include the original image 
and replicated portions thereof. 

-6- 



SOPM This function replicates or otherwise generates the final composition 

of the output page multiple times across multiple pages. In other 
words, this sends the same output page to the output device as many 
times as desired. Preferably, the system only needs to scan the image 
once or twice to provide the necessary output pages. 
With proper ordering of the finishing features, the system is able to provide 
any combination of the features in a consistent and efficient manner. Referring to FIG. 4, 
the most natural technique for performing the desired functionality is a set of nested loops. 
In a preferred ordering, the outermost loop handles the number of pages to be printed, a loop 
within the page loop handles the vertical clones, a loop within the vertical clone loop 
handles the horizontal clones. The vertical clone loop preferably includes both the 
horizontal clone processing followed by the mirror processing. 

To perform the desired functionality, the flow of control provides one or 
more of four different OPP modes. The modes may include (1) copy to printer (CTP), (2) 
copy to printer and measure encoding (CME), (3) copy to memory (CTM), and (4) print 
from memory (PFM). 

The copy to printer (CTP) function passes the data from the DSP engine 22 to 
the printer 16 without modification of the image by vertical cloning. Accordingly, the 
output of the IPP process 14 is passed to the printer 16 with modification each line of the 
image itself, as necessary, to perform horizontal cloning and mirroring. If desired, mirroring 
and horizontal cloning may be provided by the CTP function because only limited buffering 
is required to perform mirroring and horizontal cloning. For example, a buffer sufficient for 



a single output line may be used to store the resulting line of image data from horizontal 
cloning and mirroring. 

Typically the scan lines are compressed as they are transmitted from the IPP 
with the OPP process 18 for the CME and CTM modes, and thereafter typically transmitted 
in an uncompressed format to the printer 16. The CME function is similar to the CTP 
process, but in addition simultaneously measures the total size of the compressed form of the 
input image. Preferably, the input image upon which the estimated compressed size is 
determined is the image provided by the IPP process 14, which is likely smaller than the 
resulting size of a compressed image after being cloned and mirrored. During the processing 
of the page to be printed, preferably using the CME process, the system determines if the 
compressed image can be stored within the available buffer. 

If the compressed version of the image received from the IPP process 14 
would fit within the available buffer then the system may scan the image once (another time 
if the first scan is not stored in memory) and then print the image from memory, including 
processing with the OPP process, as necessary. In this manner, multiple pages may be 
printed by the system without having to re-scan the image multiple times. This system 
provides the benefit of not requiring a buffer sufficiently large to handle any potential image 
size, which may be cost prohibitive. If the image does not fit within the available buffer, 
then the copy-to-printer (CTP) process is used to print the page, which may require scanning 
the input image once for each output page. It is advantageous to provide the OPP processes 
on the buffered image for the PFM process, as opposed to the resulting image after OPP 
processes, because the buffer requirements are less. 



Due to random electronic noise in the scanning process and mechanical 
variations from one scan to the next, the present inventors have further determined that the 
compressed size of a subsequent scan may be significantly larger than the compressed size 
measured of a prior scan. With the realization of significant potential differences in the 
resulting compressed image size, the actual size of the compressed image should be 
sufficiently smaller than the actual buffer size, such as a fixed amount or a percentage 
difference. This difference in the buffer size increases the likelihood that the image may be 
reliably re-scanned and stored in the buffer. In other words, in order to determine whether 
the compressed image will fit within the available buffer based upon the prior scan, the 
measured size of the compressed image should be smaller than a threshold that is smaller 
than the available buffer. 

The copy to memory (CTM) function may be used to scan an image to the 
buffer memory. The original document is scanned once, processed by the standard copier 
pipeline (SPP and IPP), and stored in the memory buffer, normally in a compressed format. 
Thereafter, the image data is retrieved (uncompressed if compressed) and processed by the 
OPP process as many times as are necessary to produce the required number of vertical 
clones and pages. 

For use across a range of hardware architectures, the OPP process may 
support all finishing features both with and without a significant memory buffer. It is to be 
noted that without sufficient memory, true SOPM is not possible, and the OPP process 
degenerates to a scan-many-print many scenario. 

Referring to FIG. 5 a block diagram is shown for an exemplary CTP OPP 
process without a memory buffer for a single page document. The preferred process 



includes a nested structure of (a) each output page which may require re-scanning of the 
page, (b) each vertical clone which may require re-scanning of the page for each vertical 
clone, and (c) mirroring and/or horizontal cloning of each scan line. This technique is a 
highly efficient process for processing each page without a sufficient buffer for an entire 
image. It is noted that IPP refers to the image processing pipeline and likewise includes the 
SPP process as well. Also, without a significant memory buffer the input page is re-scanned 
and reprocessed by the IPP for each vertical clone and for each output page. 

Referring to FIG. 6 a block diagram is shown for an exemplary CTM process 
and PFM process with a memory buffer for a single page document. The upper portion 
describes the exemplary CTM process while the lower portion describes the exemplary PFM 
process. 

Referring to FIGS. 7A-7H is another exemplary embodiment of pseudo code 
cast in the tasking framework of an Oak Technology, Inc. (formerly Pixel Magic, Inc) 
PM44I DSP chip. The framework and its constituent primitives are described in the PM44i 
SDK User's Guide (Pixel Magic, Inc., September 1999). The following pseudo code 
fragment shows in detail the flow of control and establishes that the compositions of 
finishing features are properly handled. Note that if OPP is in the CME state and a potential 
buffer overflow is detected, the state reverts to CTP and the copy is completed as a copy 
without memory scenario. Selectively reverting to CTP is more efficient because the 
additional computational cost required to continue measuring is avoided. Note also that 
when CTM executes successfully (i.e., when the entire page has been compressed and stored 
in memory), OPP switches automatically to PFM and executes the playback portion of the 
copy with memory scenario. The active states of OPP are themselves encoded by 3 flags as 

-10- 



shown in the table below, where D -> DO DECODE; S -> DO_STORE; and E -> 
DO_ENCODE. An additional idle state exists which is in effect whenever an IDLE flag has 
the value 1. The only event that causes OPP to exit from idle state is an "activate" message 
from the CPU, which is only used during the playback portion of SOPM. The CPU sends 
this message after: 

(1) sending any necessary trailer data to the printer for the Nth page; 

(2) waiting for the printer to become ready to receive another page, if necessary; 

(3) sending the header data for the (N+l) st page; and 

(4) waiting for the printer to become ready to receive the image data for the 
(N+l) st page, if necessary. 

The pseudo code, the C-language "&" operator prefaces each argument of a 
(conceptual) function that is (conceptually) modified by execution of the function. 

It is to be understood that the present invention of processing a print ready 
data stream may likewise be used for applications that do not include the scanning of an 
image, the SPP process, or the IPP process. In this case, the print ready data stream is 
provided to the OPP process however obtained. Likewise, the output device may include a 
display, etc. In addition it is to be understood that the term image is merely intended to 
denote that the data is representative of a sensed document, an image map, a set of characters 
that may be composed, or any other representation of an output. 



A method of processing an image comprising: 

(a) sensing said image from an original document; 

(b) modifying said image by a first process to compensate for non- 
uniformities of sensing said image; 

(c) modifying said image by a second process based upon the image 
itself; 

(d) creating a print ready data stream as a result of the modifications of 
step (b) and (c); 

(e) providing a print ready data stream of said image to a third process; 

(f) modifying said image of said print ready data stream by said third 
process including at least one of: 

(i) mirroring at least a portion of image of said print ready data 
stream; 

(ii) horizontally cloning at least a portion of said image of said 
print ready data stream; 

(iii) vertically cloning at least a portion of said image of said print 
ready data stream; 

(g) providing said modified image as a result of step (f) to an output 
device. 

The method of claim 1 wherein said sensing is performed by a copy machine. 
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3. The method of claim 1 wherein said sensing is performed by a facsimile 
machine. 



4. 



The method of claim 1 wherein said sensing is performed by a scanner. 



5. 



The method of claim 1 wherein said output device is a printer. 



6. 



The method of claim 1 wherein said output device is a file. 



7. The method of claim 1 wherein said output device is a print ready file 
transferred across a network. 

8. The method of claim 1 wherein said third process includes mirroring at least a 
portion of said image of said print ready data stream. 

9. The method of claim 8 wherein said third process includes mirroring the 
entire said image. 

10. The method of claim 1 wherein said third process includes horizontally 
cloning at least a portion of said image of said print ready data stream. 

1 1 . The method of claim 10 wherein said third process includes horizontally 
cloning the entire said image. 
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12. The method of claim 1 wherein said third process includes vertically cloning 
at least a portion of said image of said print ready data stream. 

13. The method of claim 12 wherein said third process includes vertically cloning 
the entire said image. 

14. A method of processing an image comprising: 

(a) sensing said image from an original document; 

(b) modifying said image by a first process to compensate for non- 
uniformities of sensing said image; 

(c) modifying said image by a second process based upon the image 
itself; and 

(d) selectively selecting from among a first mode, a second mode, and a 
third mode; 

(i) said first mode comprising modifying said image by 
performing at least one of (a) mirroring at least a portion of 
said image and horizontally cloning at least a portion of said 
image, while said first mode is free from vertically cloning of 
said image; 

(ii) said second mode comprising storing said image within a 
buffer; 

-14- 



(iii) said third mode comprising processing said image stored 

within said buffer as a result of said second mode by said first 
mode, and providing said modified image to an output device. 

15. The method of claim 14 wherein said sensing is performed by at least one of 
a copy machine, a facsimile machine, and a scanner. 

16. The method of claim 14 wherein said output device is at least one of a printer, 
a file, and print ready file transferred across a network. 

17 The method of claim 14 wherein said first mode includes mirroring at least a 
portion of said image of said print ready data stream. 

18. The method of claim 17 wherein said first mode includes mirroring the entire 
said image. 

19. The method of claim 14 wherein said first mode includes horizontally cloning 
at least a portion of said image. 

20. The method of claim 19 wherein said first mode includes horizontally cloning 
the entire said image. 

21 . A method of processing an image comprising: 
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(a) sensing said image from an original document; 

(b) modifying said image by a first process to compensate for non- 
uniformities of sensing said image; 

(c) modifying said image by a second process based upon the image 
itself; and 

(d) storing said modified image as a result of step (c) in a compressed 
form in a buffer if said modified image requires sufficiently less 
memory for storing than the size of said buffer. 

22. The method of claim 21 wherein said image is sensed a first time to 
determine if said modified image requires said sufficiently less memory for storing than the 
size of said buffer, and said image is sensed a second time to store the resulting modified 
sensed image in said buffer. 

23. The method of claim 21 wherein said modified image is simultaneously 
provided to an output device and stored in said buffer. 

24. The method of claim 21 further comprising providing said compressed image 
to an output device multiple times free from re-sensing said original document. 

25. A method of processing an image comprising: 

(a) providing a print ready data stream of an image to a first process; 
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(b) modifying said image of said print ready data stream by said first 
process including at least one of: 

(i) mirroring at least a portion of image of said print ready data 
stream; 

(ii) horizontally cloning at least a portion of said image of said 
print ready data stream; 

(iii) vertically cloning at least a portion of said image of said print 
ready data stream; 

(c) providing said modified image as a result of step (b) to an output 
device. 

26. The method of claim 25 further comprising sensing said image from an 
original document. 

27. The method of claim 26 further comprising modifying said image by a first 
process to compensate for non-uniformities of sensing said image. 

28. The method of claim 27 further comprising modifying said image by a 
second process based upon the image itself. 

29. The method of claim 28 further comprising creating a print ready data stream 
as the result of said first and second processes. 
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30. The method of claim 25 wherein said output device is a printer. 



3 1 . The method of claim 25 wherein said output device is a file. 

32. The method of claim 25 wherein said output device is a print ready file 
transferred across a network. 

33. The method of claim 25 wherein said output device is a display. 

34. The method of claim 25 wherein said first process includes mirroring at least 
a portion of said image of said print ready data stream. 

35. The method of claim 34 wherein said third process includes mirroring the 
entire said image. 

36. The method of claim 25 wherein said first process includes horizontally 
cloning at least a portion of said image of said print ready data stream. 

37. The method of claim 36 wherein said first process includes horizontally 
cloning the entire said image. 

38. The method of claim 25 wherein said third process includes vertically cloning 
at least a portion of said image of said print ready data stream. 
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39. The method of claim 38 wherein said first process includes vertically cloning 
the entire said image. 

40. A method of processing an image comprising: 

(a) providing a print ready data stream of an image; 

(b) selectively selecting from among a first mode, a second mode, and a 
third mode; 

(i) said first mode comprising modifying said image by 
performing at least one of (a) mirroring at least a portion of 
said image and horizontally cloning at least a portion of said 
image, while said first mode is free from vertically cloning of 
said image; 

(ii) said second mode comprising storing said image within a 
buffer; 

(iii) said third mode comprising processing said image stored 
within said buffer as a result of said second mode by said first 
mode, and providing said modified image to an output device. 

41 . The method of claim 40 wherein said image is obtained by sensing by at least 
one of a copy machine, a facsimile machine, and a scanner. 



42. The method of claim 40 wherein said output device is at least one of a printer, 
a file, a display, and print ready file transferred across a network. 
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5 - 43 . The method of claim 42 wherein said first mode includes mirroring at least a 

portion of said image of said print ready data stream. 

44. The method of claim 43 wherein said first mode includes mirroring the entire 
said image. 

10 

45. The method of claim 40 wherein said first mode includes horizontally cloning 
at least a portion of said image. 

46. The method of claim 45 wherein said first mode includes horizontally cloning 
1 5 the entire said image. 
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ABSTRACT 



SYSTEM FOR SUPPORTING A MULTIPLICITY OF COPY FEATURES 



A system for processing of a print ready data stream for an output device. 
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